Multi-UAV IRS-Assisted Communications: Multi-Node Channel Modeling and Fair Sum-Rate Optimization via Deep Reinforcement Learning

نویسندگان

چکیده

Unmanned Aerial Vehicles (UAVs) combined with Intelligent Reflective Surfaces (IRSs) represent a cutting-edge technology for improving the channel capacity of wireless communications, by capitalizing on UAVs’ 3D mobility coupled IRSs’ smart radio capabilities. This work envisions scenario in which swarm UAVs equipped IRSs serves multiple Internet Things (IoT) Ground Nodes (GNs) concurrently transmitting to single Base Station (BS) via OFDMA. The huge number passive elements composing introduces significant complexity mission design. Therefore, each IRS is divided into patches that can be simultaneously used serve different nodes. Considering general Rician fading, comprehensive model IRS-assisted UAV-aided networks derived. Then, multi-objective mixed-integer non-linear programming problem conceived maximize sum-rate GNs and, at same time, minimize difference among users’ data rates, jointly optimizing trajectories and phase shift matrices. non-convex problem, reformulated terms scheduling (i.e., patch-GN assignment), challenging solve. Hence, it rearranged as Markov Decision Process quasi-optimal solution obtained Deep Reinforcement Learning. Extensive simulation analysis performed validate results accuracy proposed model.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Multi-Objective Deep Reinforcement Learning

We propose Deep Optimistic Linear Support Learning (DOL) to solve highdimensional multi-objective decision problems where the relative importances of the objectives are not known a priori. Using features from the high-dimensional inputs, DOL computes the convex coverage set containing all potential optimal solutions of the convex combinations of the objectives. To our knowledge, this is the fir...

متن کامل

Multi-Agent Deep Reinforcement Learning

This work introduces a novel approach for solving reinforcement learning problems in multi-agent settings. We propose a state reformulation of multi-agent problems in R that allows the system state to be represented in an image-like fashion. We then apply deep reinforcement learning techniques with a convolution neural network as the Q-value function approximator to learn distributed multi-agen...

متن کامل

Lenient Multi-Agent Deep Reinforcement Learning

Much of the success of single agent deep reinforcement learning (DRL) in recent years can be attributed to the use of experience replay memories (ERM), which allow Deep Q-Networks (DQNs) to be trained efficiently through sampling stored state transitions. However, care is required when using ERMs for multi-agent deep reinforcement learning (MA-DRL), as stored transitions can become outdated bec...

متن کامل

A Multi-Objective Deep Reinforcement Learning Framework

This paper presents a new multi-objective deep reinforcement learning (MODRL) framework based on deep Q-networks. We propose linear and non-linear methods to develop the MODRL framework that includes both single-policy and multi-policy strategies. The experimental results on a deep sea treasure environment indicate that the proposed approach is able to converge to the optimal Pareto solutions. ...

متن کامل

Deep Reinforcement Learning for Multi-Resource Multi-Machine Job Scheduling

Minimizing job scheduling time is a fundamental issue in data center networks that has been extensively studied in recent years. The incoming jobs require different CPU and memory units, and span different number of time slots. The traditional solution is to design efficient heuristic algorithms with performance guarantee under certain assumptions. In this paper, we improve a recently proposed ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Internet of Things Journal

سال: 2023

ISSN: ['2372-2541', '2327-4662']

DOI: https://doi.org/10.1109/jiot.2023.3299018